Author: J.C. Cross

Building an AI

Training Set

  1. Figure out what you want from the data.
  2. Determine the type of machine learning model you need, standard ML algorithms or artificial neural network.

a. If a standard ML algorithm, then it could use K nearest neighbor or Naive Bayes.
b. If a neural network, feed a training set and determine how much to change the weights.
c. Use backpropagation to adjust the weights to lower the cost function, i.e., the system will go back through the network and adjust the dials to increase its accuracy.

Test Set

  1. Data will be added from the test set. The test set will not be labeled.
  2. If the data in the training set is not sufficient for the test set to do its classifications, then that’s called “overfitting” the data.AI systems are only as good as the data they are fed. They can learn by trying different things. They can do things humans cannot–and vice versa. AIs can process large amounts of data quickly and see patterns we cannot, but they still need supervision and direction.

AI == one result?

Search engines give you a list of results. Chatbots answer in a stream of one result. Google will be able to serve you with exactly what you want, but with only one result, the bot’s answer. Many people don’t specify the options for results:

  1. Ask for a chatbot to take on a role, e.g. “you are a rocket scientist, explain…”
  2. Give context information to go with the request.
  3. Give x number of examples. The capabilities of chatbots are there for the using, but I think users need to learn how to prompt better in the pursuit of the diversity of answers. A reasoning engine, like ChatGPT, Claude, Bing Copilot, understands your question rather than just giving you rankings. Taking advantage of this difference–prompt engineering–must be a taught skill. Bingchat unites a search engine with a reasoning engine: you get the conversation with clickable sources. It’s a good sign of what is coming.
  4. Ask for competing answers, i.e. answer in the debate style with points for and against.
  5. Ask for an answer using an analogy.
  6. Ask for the bot to be creative, ideate, brainstorm, give ideas.
  7. Ask for a summary of text you input into the reasoning engine when desired.

A consideration is to be wary of the factuality of the reasoning engine’s response since it can be wrong. It can certainly sound convincing, but don’t trust everything you see or hear.

Where will your prompt take you?

Bias considerations

Considerations to help avoid bias in AI classification:

  1. Gather diverse data.
  2. Include a wide range of judges.
  3. Monitor the output of the algorithm.
  4. Attend to edge cases.

    Cover as much as you can and make sure you are addressing it as a way to overcome the inherent tendency toward bias when labeling and enhance the generalizability and utility of the work you do.

“Elon Musk” update

I’ve had to put down the Musk biography because of the new job. But I did have some opinions of what I have read so far.

There’s obviously some venom toward him. Some people think he’s brought chaos to the world; others, a new freedom for discourse. Both are true. I  certainly wouldn’t want to work for him. Yes, it’s true that he is an inspiration, especially for those on the spectrum–and I thought that for the first 500 pages of Isaacson’s book. But when the stories become repetitive, you get the idea of what it’s like in that brain of his.

He has “surges,” where he pushes his employees to outperform. Many times, his demands are successful–other times, not. He sleeps on the factory floor or in a conference room and has a preternatural ability to sleeplessly work through technological problems until they are solved.

My biking buddy Lennie said a friend who worked for Musk told him of his holding one-on-ones with employees where he doesn’t look up while you are sitting there and asks difficult questions. He’s certainly a genius in engineering and asks those Google-level interview questions.

But there may be a trail of beat-up workers: the ones that have managed to survive his firings. (He asked who wanted to remain at Twitter/X when he took over, but then fired some of the same people who decided to stay.)

So, interpersonally, he sounds like an intimidating man. But he certainly has made a dent.

Work in general

I forgot about the need for free time when you work full-time. I miss my mornings reading. But I am doing some really cool stuff for work.

In the news, some alarming items about the middle east. It’s easy to get into apocalyptic thinking.

Still thankful for fam and friends, people who prayed for me.

Been taking Jax to a new park when possible, but he gets overheated.

Letter to the American Church?

As I mentioned last November, Eric Metaxas wrote Letter to the American Church, asking believers to exercise their faith in the ballot box and in action. Metaxas juxtaposes the American church with the German church up to and during the Third Reich. I have a friend who thinks Metaxas is offbase.

Isn’t what Metaxas is saying just hyperbole? If not, then is the call upon the church loud enough?

The debate on what the church should do is a perennial one. We’re called to exercise our faith and we should put our faith into action. What is too far?

Lewis on politics and faith

So politics and faith:

“The earliest converts were converted by a single historical fact (the Resurrection) and a single theological doctrine (the Redemption) operating on a sense of sin which they already had — and sin, not against some new fancy-dress law produced as a novelty by a ‘great man,’ but against the old, platitudinous, universal moral law which they had been taught by their nurses and mothers. The ‘Gospels’ come later and were written not to make Christians but to edify Christians already made…

“Certainly we do not want men to allow their Christianity flow over into their political life, for the establishment of anything like a really just society would be a major disaster…

“The thing to do is to get a man at first to value social justice as a thing which the Enemy demands, and work him on to the stage at which he values Christianity because it may produce social justice.”

– The Screwtape Letters, 23

China unleashed

The CCP has been sending its young men to “invade” the U.S. southern border. A strange thing since we don’t know the benefit to the Party. These are men in their 20s, which would suggest they may not be married and are therefore free of reliance on the family and on the Chinese government. I don’t know if the Right is correct here. It may not be a military action.

But one thing is for sure: Chinese culture is pulling ahead. While our youth (Gen Z) are drawn into the use of China’s TikTok and other social media, their youth are studying to be engineers. It’s really shameful. Seeing some man on the street videos recently, I am disheartened that we can’t get it together. Gen Z know a lot about what they should speak, but not how.

Other events, like the Chinese selling fentanyl and the spy balloon crossing the continent, point toward the Biden administration either not giving a crap, being careless, or worst of all, doing these things purposefully. I don’t want to say that last one is true, but these actions are evil (fentanyl) or provocative (balloon). One asks why the Chinese are proliferating a drug that is deadly. Wouldn’t it be better to keep your junkies coming back instead of killing them?

It just goes to show that the friendly Chinese are not that.

Musk on wokeness

Still reading Isaacson’s Elon Musk:

“Wokeness wants to make comedy illegal, which is not cool. Trying to shut down Dave Chappelle, come on, man, that’s crazy. Do we want a humorless society that is simply rife with condemnation and hate and no forgiveness? At its heart wokeness is divisive, exclusionary, and hateful. It gives mean people a shield to be mean and cruel, armed with false virtue.”

I would add that it is stifling; can’t breathe.

China EV threat

I am continually flummoxed about the U.S.’s uncommitted actions against the Chinese Communist Party’s intentions here, namely its in-roads to the U.S. technology markets. Now we may have taken notice about the auto industry?

As to data, even though the White House announced a new executive order that aims to prevent “countries of concern,” including China, North Korea, and Russia, from purchasing sensitive data about Americans, I am not optimistic.

We know that China is using slave labor to manufacture various technologies and products. We know that they are propping up their sagging markets through government action. We know that they are not a friendly competitor.

We have to look on them as an authoritarian foe. We have to take action to curb their intrusions. The West as a whole needs to.

More China trouble

China has its tentacles into our
infrastructure. While the nation is diverted with other important issues. Also been watching the border situation get worse. When mainstream media outlets report on the issue then you know it’s not fake news.
“Last year, U.S. Customs and Border Protection reported 37,000 Chinese citizens were apprehended as they illegally crossed the border; that’s 50 times more than two years earlier.”

Chaos reigns.

Christian nationalism without the nationalism

Just watched the PBS Newshour segment on Brad Onishi, who is a former evangelical minister who once identified as a “Christian nationalist.” The term is just too broad. During the segment he assumes that white evangelicals are the source of pro-Trump activism. He now hosts a (supposedly-popular) podcast “Straight White American Jesus” and wrote “Preparing for War: The Extremist History of White Christian Nationalism and What Comes Next.” Let’s just say that not many people are going to buy something the mainstream media gives them for free every day.

His failure to differentiate a small minority of people who actually say they are “Christian nationalists” from other right-wing and mainstream evangelicals is just an attempt to promote himself. The segment interviewed no subjects who would consider themselves Christian nationalists.

Poor segment, poor analysis.

Can AI ever know these senses?

In addition to the well-known five senses (sight, sound, taste, hearing, feeling), proprioception tells you where your body is in space. Your balance and the tilt of your head are not something you really perceive. Certain neurons sense your movement and detect stretching in muscles and tendons. This helps you keep track of your limbs.

I also know that people will “feel like” a person is in their airspace.

Other physical receptors detect oxygen levels in some of the arteries of your bloodstream.

A strange one is that people with synesthesia see sounds as colors or associate some sights with smells.

Will AI ever be able to create these sort of senses? There’s entirely too little appreciation for the human mind and body. AI has amazed us, but the human brain is capable of so much more than generative AI. I encountered a certain businessman at a friend’s party who, when I said AI is not AGI yet, was was wowed by the technology of ChatGPT and couldn’t believe that it was not yet human-level.

Whether you call it AGI yet, there is so much more to the human being and I don’t see AI robots having these senses.